arXiv:1507.00174v3 [math.OC] 17 Feb 2016 


From Quasidifferentiable to Directed 
Subdifferentiable Functions: 

Exact Calculus Rules 

Robert Baier* Elza Farkhi^ and Vera Roshchina^ 
February 18, 2016 

Dedicated to the memory of V. F. Demyanov 

Abstract 

We derive exact calculus rules for the directed subdifferential de¬ 
fined for the class of directed subdifferentiable functions. We also state 
optimality conditions, a chain rule and a mean-value theorem. Thus 
we extend the theory of the directed subdifferential from quasidiffer¬ 
entiable to directed subdifferentiable functions. 
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1 Introduction 

This paper is a continuation of [8] in which we showed that the directed sub¬ 
differential introduced for differences of convex (DC, delta-convex) functions 
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from M"" to M [1] and extended for quasidifferentiable (QD) functions [HIE], 
can be constructed from the directional derivatives only, without any infor¬ 
mation on the delta-convex structure of the function. Both DC and QD 
functions are a continued matter of research in sub differential calculus, see 

e.g. nmniiniiiaiEe]. 

Our work is strongly motivated and connected to the research of Vladimir 
Demyanov and his collaborators (see e.g. mi), who pioneered the study of 
constructive tools of nonsmooth analysis. The foundations of our develop¬ 
ments can be found in quasidifferential calculus, but the main contribution 
of this work is that we eliminate the need for the DC representation of the 
directional derivative that is crucial for the construction of quasidifferen¬ 
tial. Thus we extend further the family of functions for which the directed 
subdifferential can be defined and label the functions of the extended class 
as directed subdifferentiable. This class contains locally Lipschitz functions 
definable on o-minimal structures and quasidifferentiable functions (as well 
as such important subclasses as amenable functions and their negatives and 
lower/upper-C^ functions for /c > 1), see [S]. The directed sub differential is 
visualized in M” as a generally nonconvex set called Rubinov subdifferential. 
The exact place of the Rubinov sub differential in the chain of inclusions be¬ 
tween other known sub differentials is investigated in HE]. We only remind 
here that its convex hull is the Michel-Penot sub differential (which is a subset 
of the Clarke subdifferential), and the Dini sub differential is a convex part 
of it. All these known subdifferentials do not enjoy exact calculus rules in 
the nonconvex case in contrast to the directed one. As we show here, the 
directed sub differential enjoys exact calculus rules in the general class of di¬ 
rected subdifferentiable functions, and the same sharp optimality conditions 
as the Demyanov-Rubinov quasidifferential or the Dini subdifferential and 
super differential. The optimality conditions presented here are formulated 
using the order in the space of directed sets, but may be easily expressed by 
inclusion of the zero in the Rubinov sub differential, as it is done in [HIHIEI- 

Note that the directional derivative [TT1[T6] is a main ingredient of the 
directed sub differential as well as of the constructed calculus rules and opti¬ 
mality conditions. The exact calculus rules for the directional derivatives 
allow to extend automatic differentiation algorithms to structured nons¬ 
mooth functions, such as min- and max-type functions and their compositions 
(see [9111411151118] 1. In some of these works, the propagation of nonsmooth con¬ 
vex or concave McCormick relaxations [19] are used and subgradient propa¬ 
gation as e.g. in [20] is applied. In contrary to this approach with McCormick 
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relaxations, where only a subset of the entire subdifferential can be obtained 
for some examples as stated in [201 Sec. 4.3], we rely on exact calculus rules 
for the directed subdifferential, which is more in-line with the approach of 
V. Demyanov and A. Rubinov. 

The inductive construction of the space of directed subdifferentiable func¬ 
tions with respect to the dimension is based on the same principle as the con¬ 
struction of the space of directed sets and is reflected by the inductive proofs 
of our main results. As the space of directed sets contains differences of em¬ 
bedded convex compact subsets of M", directed subdifferentiable functions 
include DC and QD functions. 

The paper is organized as follows. The calculus rules for algebraic oper¬ 
ations on directed subdifferentiable functions as well as for pointwise maxi¬ 
mum and minimum are derived in Section [21 in Section [3] we study necessary 
optimality conditions for directed subdifferentiable function, and Section 0] 
contains results related to a chain rule and a mean-value theorem for this 
function class. 

We use the standard notation: by || • || we denote the Euclidean norm, 
and is the unit sphere in M”. We denote by cl A the closure of the set 
A and by co A its convex hull. 


2 Calculus Rules 


The functions we are working with are a bit more general than tame (de- 
hnable) locally Lipschitz ones. Readers familiar with tame or semialgebraic 
geometry may keep this in mind, as other examples of directed subdifferen¬ 
tiable functions are exotic and are unlikely to be met in applications; on the 
other hand, delta-convex and quasidifferentiable functions are also directed 
subdifferentiable [8]. 

A function from M” to M is directed subdifferentiable if its Dini directional 
derivative restricted to lower-dimensional subspaces is {n — 1) times (recur¬ 
sively) directionally differentiable on M"", and all such recursive directional 
derivatives are uniformly bounded. We will soon give a precise dehnition. 

For a function / : M” —)■ M we denote by Vf{x) = the gradient 

of / at the point x G M”, and by f'{x;l) we denote the (Dini) directional 
derivative of / at a; in the direction / G M”, 
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The function is called directionally differentiable at x (see m Chap. I, §3.1] 
and [23]), if the limit /'(x; 1) at x exists for all I G 

Denote by a fixed linear transformation from M” to that 

isometrically maps the orthogonal complement of the vector I to and 

maps I to zero, see W- The mapping ; is the inverse of Yin-i,h and 
maps onto the (n — l)-dimensional subspase of M" that is orthogonal 
to 1. 

Definition 2.1 (directed subdifferentiable function). A function f : 
M —)■ M zs called M-directed subdifferentiable at x G M z/ both its left- and 
right-sided derivative exist and 

max{|/'(x; -1)|, |/'(x; 1)|} < M . 

A function f : M"" —)• M, n > 2, zs called M-directed subdifferentiable at 
X G M" if its directional derivative /'(x; /) exists for every I, is continuous as 
a function of the direction I, is bounded by M, i.e. 

max |/'(x; /)| < M, 

lGSn—1 

and the restriction /;(•) = f'{x;l -|-;(•)) : —)■ M of its directional 

derivative to I span{l}^ is also M-directed subdifferentiable at 0„_i for all 
I G 

ITe say that a function is directed subdifferentiable if it is M-directed 
subdifferentiable for some M > 0. 

Observe that every univariate directionally differentiable function / : 
M —)■ M is directed subdifferentiable, as we only need to consider the ‘first 
order’ directional derivatives which are trivially bounded. 

The directed sub differential is an object in the Banach space of directed 
sets, dehned in [2l[3]. Directed sets are defined recursively in the dimension: 
a one-dimensional directed set is an ordered pair of two numbers, and for 
n > 2 a directed set maps iS„_i to a two-component object that consists of 
a directed set of dimension n — 1 and a real number (the value of the gen¬ 
eralized support function). The real-valued component must be continuous, 
and the directed set component must be uniformly bounded on (in a 
recursively dehned norm induced by the lower-dimensional directed sets and 
the lower-dimensional generalized support functions). The basic facts about 
the Banach space of directed sets can be found in [31IB], and more details 
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are available in [21[3] . We provide the definition of the directed set and some 
other necessary definitions for convenience, even thongh this may make the 
paper appear a bit repetitive. 

Definition 2.2. We call a directed set 

(i) inM., z/zt is a directed interval = [—ai(—1), ai(l)] := (ai(—1), ai(l)). 
Its norm is ||X||i = max|ai(/)|, 

i=±i 


(ii) inM”, n>2, if there exist a continuous function an '■ Sn-i M (named 
as generalized support function^ and a map having lower-dimensional 
directed sets as images An-i ; which is uniformly 

bounded with respect to || • ||n-i- 

We denote = {An-i{l], an{l))ieSn-i define its norm as 

ll^ll := ll^lln := max{ sup \\An-i{l]\\n-i, max \an{l)\} ■ 

l€Sn-l l&Sn-l 


The set of all directed sets in M” is denoted by ©(M”). 

The embedding of convex compact sets into the space of directed sets 
P(M”) is defined as follows. We distinguish two cases, i.e. 


(i) in M, if A = [a*,a^], then the embedded direct ed interval is 
Ji{A) := {—a\a^) which is also denoted as [a\a^], 




(a) in M”, n > 2, for a convex compact A, A = Jn{A) is defined as the 
family of pairs {An-i{l], S*{1, A))i^Sn-i! where 


An-i{l) := n„_i,z(argmax(l,x)) (1 G 5n-i), 

x€A 

and argmaXxgA (l^x) is the (n — 1)-dimensional supporting face of A 
and 

5*(I, A) = max (/, x) 

xeA 

is the support function of A. 

Thus, the convex compacts in M” are embedded in the space of directed 
sets P(M”) with the help of their support functions and supporting faces. 
Conversely, a directed set in P(M”) can be mapped to a compact set in M” 
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with the help of the visualization mapping Vn- Details on the visualization 
may be found in PUMT] . We only note that for embedded convex compact sets 
the visualization map is the inverse of the embedding map. Since the directed 
sub differential of a convex function is the embedded convex subdifferential 
into D(R”) (see e.g. |ll|6l[7]), the visualization of the directed sub differential 
(which is called Rubinov subdifferential) for a convex function coincides with 
its convex sub differential. 

The directed subdifferential is an object in the space of directed sets 
dehned for every directed subdifferentiable function as follows. 

Definition 2.3. Let f : R” —)■ R &e directed subdifferentiable, then for any 
fixed X G R" the directed sub differential of f at x can be defined as follows: 

(i) Forn = 1, define 

~Sf{x) ■= [-f'{x; -1); /'(x; 1)] := (/'(x; l))i=±i . (1) 

(a) Forn > 2, define 

'3’/(x) := (^/i(0),/'(x;/)) 

V / leSn-i 

where f : R”“^ —)■ R zs defined by /;(■) := /'(x; I + n((_j^^;(-)). 

We extend calculus rules already known for DC and quasidifferentiable 
functions to directed subdifferentiable functions, and introduce rules for ad¬ 
ditional operations: pointwise maximum and minimum, multiplication and 
division. 

The next proposition shows that the directed sub differential of the di¬ 
rectional derivative is the same as the one of the function /, thus general¬ 
izing [5l Proposition 3.15], [TJ Proposition 5.2] for DC resp. QD functions. 
There is also a close link to the result in [ini (35)] in which the Clarke’s 
subdifferential of the directional derivative yields a smaller subdifferential, 
the Michel-Penot subdifferential. 

Proposition 2.4. Let f : R"' M. be directed subdifferentiable in x & R”. 
Then 

'^[/'(^;-)](o) = f{x). 
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Proof. Let (p{y) := f'{x-,y). Then by the positive homogeneity of the direc¬ 
tional derivative we have 


ojTO; 1) = lim 
40 


f\x-,U) - f\x;0) 
t 


40 t 


fix;l). 


Since the directed subdifferential is dehned uniquely through the directional 
derivative, the result is proved for all state dimensions n. □ 


2.1 Algebraic operations 

Our proofs of the calculus rules rely on the following well-known properties 
of the directional derivatives in m Proposition 3.1 from Sec. 1.3]. 

Lemma 2.5. Let /i ,/2 : M"' ^ M 6e directionally differentiable at x E M”. 
Then their linear combination, product and quotient (if f 2 {x) Oj are also 
directionally differentiable at this point and the following formulas hold for 

M”.- 

(a/i + I^f 2 )\x] 1) = af[{x; 1) + ff^ix] 1 ), 

(/i • f2)'{x-l) = fi{x)f2{x-l) + f2{x)f[{x-l) , 

(hS ( _ /i(^)/2(a^; 0 - f2{x)f'i{x-1) 

V/ 2 J ^ [f2{xW 

We recall the dehnitions of algebraic operations on directed sets hrst. 
Observe that these rules are designed to be consistent with the corresponding 
operations on convex sets and pairs of convex compacts. 

Linear operations on directed intervals are dehned in a natural way and 
are motivated by the operations for vectors in for directed intervals [a, fe] 
and [c, d] and any a, (3 eM. 

a[a, b] + (3[c, d] := [aa + (3c, ab + fdd] . (2) 


The linear operations are dehned recursively on the two components of 
the directed sets ^ an( 0 ) 45 „_i, ^ = {Bn-i{l!),hn{l))i 


)l^Sn — \ • 


Z ^ {An-l{l] + Bn-l{l], an{l) + hn{l))l£Sn-i 1 

A ■ Z := (A ■ An-iif^, A ■ an{l))i£s„-i (A G M) , 

+ = (ZZZZ5 - an(/) - • 


( 3 ) 
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We start with the simplest algebraic operation, the sum of two directed 
subdifferentiable functions which results in the exact sum rule for the directed 
sub differential. 

Proposition 2.6 (directed subdifferential of a linear combination). 

Let fi, /2 : M" —)■ M 6e directed subdifferentiable at x ElSL and a, /3 G M. 
Then f = afi + /3f2 is also directed subdifferentiable and 

f{x) = fi{x) + 0f 2 {x). (4) 

Proof. From [S], Lemma 5.2] we know that / is directed subdifferentiable. It 
remains to show (jH). 

We use the induction argument on the space dimension n. We first prove 
the statement (j4]) for n = 1. Using Definition 12.31 Lemma [2.51 and properties 
of operations on directed intervals, we have 

f{x) = [-f\x]-l)J\x]l)] 

= [-{af[{x; -1) + Pf^ix; -1)), af[{x; 1) + Pf^ix; 1)] 

= a[-f[{x-, -1), f[{x-, 1)] + P[-f 2 {x-, -1), / 2 (x; 1)] 

= fi{x) + P~^f 2 {x). 

Now assume that (jll) holds for n — 1. We show that it is also valid for n. 
By Lemma [2.51 we have for all I G 

f(x; 1) = af[{x-, 1) + Pf^ix] 1 ), 


hence, for all y G M”' ^ 


fi{y) = (^{fi)i{y) + P{f 2 )i{y) 

and by the directed subdifferentiability of {fpi, i = 1, 2, and [8|, Lemma 5.2], 
we conclude that fi is directed subdifferentiable at y = 0. Therefore, by the 
induction assumption for all I G we get 

d/,(0) = ad(/,),(0) + /3U/2)i(0) 


(5) 











Now, from Definition 12.31 (E]) and the definition of addition and scalar mul¬ 
tiplication on directed sets we have 

~Sf{x) = (a~^{fi)i + (]~i{f 2 )i,af[{x-,l) + /3f2{x;l)) 

V y ies„-i 

= fi{x) + /3~Sf 2 {x). 


□ 

Observe that the multiplication with negative scalars is possible in the 
last proposition. 

Next we consider the product of directed sub differentiable functions and 
derive the Leibniz rule for the directed sub differential. 


Proposition 2.7 (directed subdifferential of product and ratio). 

Let /i, /2 : M" ^ M be directed subdijferentiable at a; G M”. 

Then f = fi ■ f 2 is also directed subdijferentiable at x and 

= fi{x)~^f 2 ix) + f 2 {x)~S fi{x). 


Moreover, if f 2 {x) 7 ^ 0, then / = / 1//2 is also directed subdijferentiable and 

f2ix) - f2{x)'^fi{x) 


^/(x) = 


[hixW 


Proof. We will use the calculus rule in Lemma 12.51 for the directional deriva¬ 
tive of a product of functions. The proof proceeds by induction with respect 
to n. For the directed intervals we have 


~ifix) = [-f{x-,-l)J'{x;l)] 

= [-fi{x)f 2 {x; - 1 ) - f 2 {x)f[{x-, - 1 ), /i(a:)/ 2 (x; 1 ) + f 2 {x)f[{x-, 1 )] 
= fi{x)[-f 2 {x; - 1 ), f 2 {x-, 1 )] + f 2 {x)[-f[{x-, - 1 ), f[{x-, 1 )] 

= fl{x)~^f2{x) + f2ix)~^fi{x) . 


Assume now that the proposition is true for n = k — 1 for some k > 2. For 
n = k,hy Lemma [2.51 we have for all I G M"" 

fix] 1) = /i(x)/2(x; 1) + f2{x)f[{x-, 1) , 
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and hence for all y ^ 


fi{y) = fi{x){f 2 )i{y) + f 2 ix){fi)i{y). 


By Proposition 12.61 this yields 


= /l(l)'^(/2)l(0) + /2(l)'^(/i),(0). 


( 6 ) 


Therefore, we have 


V / leSn-1 

= if 2 ) 1 ( 0 ) + /2 (x)^(/i)/(0),/i(x)/2(x;/) + f2{x)f[(x-,l)) 

V / l€S, 

= fl(x)'tf 2 (x) + f 2 (x)'tfi(x) . 


The proof of the expression for the directed subdifferential of a ratio is 


analogous and is omitted. 


□ 


2.2 Pointwise maximum and minimum 

To describe the calculus rules for pointwise maximum and minimum, we hrst 
ought to dehne the corresponding operations on directed sets. The supre- 
mum and inhmum operations have already been dehned for pairs of directed 
sets in [2] and are based on the order in this space, see [21 Dehnitions 3.5 
and 4.6], [7]. Note that the notion of the supremum of two directed sets is 
consistent with the convex hull of the union of two convex sets. 

Definition 2.8 (supremum and infimum of directed sets). 

(i) Let n = 1, I = {!,...,p} and = [a~,a^], i E I, be directed 
intervals. Define the supremum and inhmum 
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we define the supremum and infimum 



iGSn—l 


mr 

i€l 


f{^P = ( 



.inf 


l€:Sn — l 


where I{1) = {i \ <(/) = max^g/a^(/)}, J{1) = {i \ al,{l) = miiifeg/a^(/)}. 

We will use a property of the min/max operations on directional deriva¬ 
tives, proved in [m Corollary 3.2 in Sect. 1.3]: 

Lemma 2.9. Let /j : R" —)■ M, i e J = {1, 2,... ,p}, be directionally differ¬ 
entiable at X G R”' for all I G 

Then pointwise maximum function /max(‘) := niaxig//j(-) and the point- 
wise minimum function /mm(-) := niinjg//i(-) are also directionally differen¬ 
tiable at X with 



where I{x) := {i e I \ ffix) = fras.^{x)}, J{x) := {i e I \ ffix) = fminix)}. 

Proposition 2.10 (directed subdifferential of a pointwise maximum). 

Let fi : R” —)■ R &e directed subdifferentiable at x & R” fori G / = {1, ... ,p}. 

Then the pointwise maximum function / : R" —)■ R, /(x) = maxjg/ ffix) 
is also directed subdifferentiable at x and 



(7) 


iGl(x) 


where /(x) = {t G / 1 /(x) = ffix)} is the set of active indices. 


Proof. Observe that / is directed subdifferentiable by [HI Lemma 5.3], hence, 
it remains to show ([7]). As usual, we use the induction argument. 

For n = 1: Let /i, ... ,/p ; R^ —)■ R^ be directed subdifferentiable at x G 

R, and denote ffix) = [d~,df]. Then by Lemma [231 / is directionally 
differentiable with a hnite directional derivative 


/'(x; /) = mjnc{/'(x; /)} for / G {-1,1} , 


iei{x) 
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where I{x) = {i E I \ f{x) = fi{x)}. By Definitions 12.31 and 12.81 we can write 
'^fix) = [-f{x]-l),f{x-,lj] 


= - max{f{x; - 1 )}, niax{/'(a:; 1 )} 

iGl{x) iGl{x) 

We thus have our induction base for n = 1. 

Now assume that the result is true for n — 1, we show that it is also true 
for n. Notice that for given y G 

My) = I + = max //(x; I + Mi-i^iy) = max{fi)i{y) . 

iei{x) i&i{x) 


= sup {'^/i(a:)} . 

iGl(x) 


Since for any i = the function (/*); is directed subdifferentiable by 

Definition 12.11 and the relevant max-function is directed subdifferentiable 

— ^ ^ 

by [H Lemma 5.3] and our induction assumption d /^(O) = supjg/( 3 ,) d (/i)z(O). 
Therefore, 




■^/(x) = (c^/z( 0 ),/'(x;/))ig 5 „_, = (sup d{fi)i{0), 

i£i{x) ^e/(x) 


Since M^) = ('3’(/i)z(0),/'(x;this yields 

"^/(x) = sup ’^/z(x). 

i£l{x) 


□ 


Note that in general only inclusion results for other sub differentials are 
available for pointwise maximum or minimum. See [22] for a discussion of this 
issue and an improved inclusion rule for min-functions and the Mordukhovich 
sub differential. 

The following statement is proved similarly to the previous one. 

Proposition 2.11 (directed subdifferential of a pointwise minimum). 

Let fi : M” —?■ M 6e directed subdifferentiable atx E M"" fori E I = {1, ... ,p}. 

Then the pointwise minimum function f : M” -E M, /(x) = minjg/ fi{x) 
is also directed subdifferentiable at x. Moreover, 

~if{x)= inf{^/i(x)}, 

i&I(x) 

where I{x) = {i E I \ /(x) = /i(x)} is the set of active indices. 
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3 Optimality Conditions 

Recall that the classical nonsmooth optimality conditions for a nonsmooth 
functions can be stated in terms of the directional derivative: if the function 
attains a local minimum at x, then f'{x]l) > 0 for all directions I G 
For a convex function this condition translates into the inclusion 0 G df{x), 
where df{x) is the Moreau-Rockafellar sub differential of /. For differentiable 
convex functions this sub differential is a singleton and the latter condition 
is just the Fermat rule f'{x) = V/(a;)^ = 0. Here we show that the opti¬ 
mality conditions for directed subdifferentiable functions generalize both the 
Fermat rule for differentiable functions and the above inclusion for convex 
functions. In the space of directed sets, we replace the relations of set in¬ 
clusion by inequalities expressing the partial order in this space. Similarly, 
the necessary conditions for QD functions in [TOl (28)] formulated with the 
Michel-Penot sub differential have a close link with the visualization of the 
directed subdifferential. 

Remark 3.1. Let f : M” —)■ M 6e Frechet differentiable. Then, f is directed 
subdifferentiable with 

tf(x) = J„({V/(i)T}) = J„({/'(i)}). 

By the assumption and an Subsec. III.2.1, l.J, f is quasidifferentiable with 

f'(x; 1) = Vfixyi = S-(l, {Vfixy}) - syi, e{0}). 

and the quasidifferential is given by the ordered pair of two singleton convex 
sets, Dqf^x) = [{V/(x)'''}, {0}] . Since quasidifferentiable functions are a 
special case of directed subdifferentiable ones, we can apply the results in m 
Subsec. 4 . 2 ] so that 

~if{x) = ~iQDf{x) = J„({V/(x)^}). 

For a directed subdifferentiable function, we can state optima^y condi¬ 
tions in terms of the order relations between the embedded_zero _Q and the 
directed subdifferential, which can formally be written as 0 < o f{x). To 
make this expression precise we hrst recall the dehnitions of the order relation 
on directed sets, and of the directed zero. 

The partial order on the space of directed sets can be introduced using 
the notion of supremum discussed in the previous section: 

= sup{(^, 
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which can be made explicit as follows (see [H Definition 4.6]). 

Definition 3.2. For two n-dimensional directed sets and ^ we define the 
partial order and write < 

(i) for every I G one has an{l) < bn{l); 

(a) whenever n > 2, and an{l) = bn{l), one has An-fil] < 

We can define a directed zero as a trivial directed set with all components 
being recursively zero. This set corresponds to the embedding of the singleton 
{ 0 „} in the space of directed sets. 

Definition 3.3 (directed zero). Forn = 1, the zero directed interval is 

when n > 1 , we define the directed zero as 

On (0 n— 1 ) 0 );g 5 ^_j. 

Whenever the dimension is clear from the context, we denote the directed 
zero by 0 . Clearly, this is the neutral element for the addition in 

The following technical result is helpful in proving the optimality condi¬ 
tions in terms of directed sets. 

Lemma 3.4. Let f : M” M. be a directed subdifferentiable function. 

If f attains a local minimum at x, then whenever f'{x;l) = 0 for some 
I G iSn-i, the function /;(•) = f'{x; I -|- fi-)) attains a global minimum at 

0 . 

Proof. Assume the contrary, i.e. f'{x] /) = 0 and that there exists y G 
such that fi{y) < fi{0). Hence, 

f{x-,l + Ul_,^fiy))<f'{x-,l )=0 

follows which is impossible, since x is a local minimum, and the directional 
derivative f'{x] 1 ) is must be non-negative for all values of 1 . □ 
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Proposition 3.5 (necessary optimality condition). Let f : ML ^ M. be 

directed subdifferentiable. If x is a local minumum of f, then 

if < ^/(x), (8) 

whereas if x is a local maximum, then 

if < —~^f{x). 

Proof. We prove the necessary condition for the local minimum only, as the 
necessary condition for the local maximum is symmetric: it can be proved 
by considering the local minima of —/, and applying the calculus rules to 
the directed sub differential. 

By the dehnition of partial order, (| 8 ]) is equivalent to showing that if x is 
a local minimum of /, then 

^/(x) = sup{lf, "^/(a:)}. (9) 

First of all, observe that the statement is true for n = 1: if a function 
/ : M —)■ R attains its local minimum at x, then f'{x] — 1 ) > 0 , f'{x] 1 ) > 0 , 
and hence 

^/(x) = [-f{x]-l),f{x]l)] 

= [min{0,-/'(x;-l)},max{0,/'(x;l)}] = sup{lf, "^/(x)}. 

To prove the statement for n > 2, we proceed by induction. Assume 
that the statement is true for n — 1. Let / have a local minimum at x, then 
f'{x]l) > 0 for all /, and hence 

max{0, f'{x] /)} = f'{x] 1) V/ e 5„_i. (10) 

Whenever f'{x] 1) = 0, fi attains the minimum at 0„_i by Lemma [T4l Hence, 
by the induction assumption we have 

sup{ 0 llt,'^/i( 0 )} =’3’//(0) yi:f{x;l) = 0. ( 11 ) 

We now have (jO]) from ffTOjl - flTT]) and the dehnition of supremum. □ 

In the particular case when / is differentiable, its directed sub differential 
is an embedded singleton containing the gradient and it is easy to see that 
the inequality ([ 8 ]) between two embedded singletons is reduced to equality, 
which is equivalent to the Fermat rule. 
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4 Chain Rule and Mean-Value Theorem 


The developments of this section are based on the following result on the 
composition of a nonsmooth and a smooth function which is stated in [TTl 
Sec. 1.3, Theorem 3.3] for a more general outer function which is Hadamard 
differentiable. Here, we only need a subclass of Hadamard differentiable 
functions (cf. [HI Sec. 1.3, Proposition 3.2]). 

Lemma 4.1. Let h : M"’ — )■ be directionally differentiable at x ^ R"' and 

g : R”^ —)■ R directionally differentiable and Lipschitz continuous at h{x). 
Then the composition f = g o h is directionally differentiable at x with 

fix; 1) = g'ihix); h'{x; /)) (/ G 5„_i). 

We prove here a chain rule for the directed sub differential of the com¬ 
position of two functions, with the first function (hence, the composition) 
defined on an interval. We apply this rule to derive a mean-value theorem 
for the directed subdifferential. 

There is a difficulty to extend the chain rule to compositions of multi¬ 
variate functions, since the expected product of a matrix (the Jacobian) and 
a directed set (the directed subdifferential) has been defined yet only for 
directed sets which are limits of differences of embedded convex sets. 

The next proposition allows to change the inner function by its first Taylor 
approximation within a composition without changing the directed subdiffer¬ 
ential. This result can be seen as a motivation to demand Ioffe’s axiom (SD 7 ) 
for sub differentials in [m Chap. 2 , Subsec. 1.5]. 

Proposition 4.2. Let G R"" and / : R"" —)■ R 6e in the form 

f{x) = (g oip){x) (xgR*"), 

where (p : R"’ —)■ R™ is Frechet differentiable in x^, g : MF ^ R is directed 
subdifferentiable and locally Lipschitz in (p{xf. Letip{y) = ip{xf + (p'ixfiy — 
a:°) for y E ML. 

Then, the directed subdifferential of f and f = g otp coincide at x^, i.e. 

Proof. Clearly, Up is differentiable with 

(p{x^) = (pix^) , f'ixf = f{xf 
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as the first-order Taylor approximation of (p. 

We claim that the directed sub differential oi g o in coincides with 
the one oi g o ip. Indeed, by the differentiability of ip in and the Lipschitz 
continuity of g., we can apply Lemma [4.11 which shows 

7'(x°; 1) = = /'(^°; 0 {l e K") 

and therefore the equality of the (second) component of d /(x°) and d /(x°). 
In its hrst component for n > 1, the directed subdifferential of the function 
fi appears. For this function we can use the previous equality which yields 

My) = 7'(x°; / + uMim) = ^ = My) 

for y G Hence, by induction 

7’7(a;°) = . 


□ 

The following proposition is a special form of a chain rule for a composi¬ 
tion of a directed sub differentiable and a continuously differentiable function. 
It is used later in the proof of the mean-value theorem. 

Proposition 4.3. Let to eM. and / : M —)■ M 6e in the form 

f{t) = {g oip){t) (tGM) 

where (p : M —)■ M"* is differentiable at to and g : M™' —?■ M is directed 
subdifferentiable and locally Lipschitz at (pifo). 

Then, / : M —)■ M is directed subdifferentiable at to with 

^/(^o) = [-g'Miio)', -V^'(io)), ^V(^o); V?'(^o))]- (12) 

Proof. The proof follows directly from Lemma 14.11 and the dehnition of the 
directed subdifferential. □ 

Remark 4.4. Observe that the expression (IT^ cannot be simply written 
as d fifo) = ip'ifo) d g{ip{to)), since then ip'ifo) has to play the role of a 
(yet undefined) linear operator from ©(M”*) to P(M) satisfying a property 
analogous to Ioffe’s axiom (SDj) in m- Of course, this linear operator may 
be easily defined in the case when g is differentiable and the directed sets 
involved are embedded singletons. 
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In the special case when the inner fnnction is affine, we get the following 
formula for the directed sub differential of the composition from the previous 
proposition. 

Corollary 4.5. Let G M” and let g : ^ W be directed sub- 

differentiable and Lipschitz continuous on the line segment co{x°,x^} = 
{x^-\-t{x^—x'^) I f G [0,1] }. Then, / : [0,1] —)■ M with f{t) = g{x^-\-t{x^—x^)) 
is directed subdifferentiable for every t G [0,1] with 

f{t) = [—g'{x^ + t{x^ — x°); —(x^ — x°)),g'{x^ + t{x^ — x°); — x°)]. 

The following mean-value theorem is an analogue of Proposition 1.115] 

for the directed subdifferential. In [21] the mean-value theorem is formulated 
with the basic symmetric subdifferential which has a very close connection 
to the visualization of the directed subdifferential in see [Sj. 

Theorem 4.6 (mean-value theorem). 

Let x°,x^ G M"' and g : ML ^ W be directed subdifferentiable on the open 
segment A = {x° -|- t(x^ — x°) | f G (0,1) } and Lipschitz continuous on cl A. 
Then there exists t G (0,1) such that 

- ^(^°)}) < - x°))(f). (13) 

Proof. Define the affine function (p : [0,1] —?■ M” by ip{t) = x° -f t{x^ — x^), 
flit) = 9iTit)) and / 2 (t) = t{g{x^) - g{x^)) for t G [0,1]. Then, (p([0,1]) = 
c\A and we set the function / : [0,1] —)■ M by f{t) = fi{t) / 2 (t). 

Clearly, (p, /2 are on [0,1] and / is directed subdifferentiable by Propo¬ 
sition 12.61 and Corollary 14.51 with 

fit) = hit) + hit ). 

The function / is also continuous on [0,1] and satisfies /(O) = /(I) = 
gixh- Therefore, either / is constant on [0,1] or it attains its global ex¬ 
tremum (minimum or maximum) at some point in (0,1) by the classical 
Weierstrafi theorem. In both cases, / has a local extremum in the open 
interval (0,1) and by Proposition 13.51 there exists a point t such that 

t<~Sf{i). (14) 
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For the function fi we apply Proposition 14.31 to obtain 

= - x°)),g'(x; - x°)], (15) 

where x = x^ + t(x^ — x^). Since the function f 2 (t) = t(g(x^) — g(x^)) is 
differentiable, we apply Remark 13. II 

tMt) = Ml/m) = - 9(x‘)}) 

Hence, 

"^/(t) = + ^/2(t) 

The inverse of an embedded scalar in D(M) is the embedded negative scalar 
so that ffT4|) transfers to the asserted inequality 

- 9 {x°)}) < [-g\x]-{x^ - x^)),g'{x; x^ - x°)]. 


□ 


5 Conclusions 

While in [8] we introduced the class of directed subdifferentiable functions, 
this paper is devoted to calculus rules for their directed sub differential. Let us 
stress that the calculus rules are given by equalities, even for the sum rule and 
for maximum or minimum of directed subdifferentiable functions, without 
any delta-convex structure of the functions or their directional derivaties. 

Thus, we obtain exact calculus rules, similar formulas to those for the 
quasidifferential of Demyanov/Rubinov, and avoid inclusions in the calcu¬ 
lation of the directed sub differential. Also the chain rule is extended here 
from the class of quasidifferentiable to directed subdifferentiable functions. 
The visualization of the directed sub differential (the so-called Rubinov sub¬ 
differential) is related not only to convex subdifferentials, as the Dini and 
the Michel-Penot subdifferential, but also to the (nonconvex) basic subdif¬ 
ferential of Mordukhovich M- The mean-value theorem and the numerical 
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calculation of the directed subdifferential may open the way to numerical 
algorithms for nonsmooth optimization problems. More concrete applica¬ 
tions of the directed (or Rubinov) subdifferential to nonsmooth optimization 
problems and algorithms are the subject of a forthcoming work. 
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